FreelMU: An Open Hardware Framework for 
Orientation and Motion Sensing 



Abstract. Orientation and Motion Sensing are widely implemented on 
various consumer products, such as mobile phones, tablets and cameras 
as they enable immediate interaction with virtual information. The pro- 
totyping phase of any orientation and motion sensing capable device is 
however a quite difficult process as it may involve complex hardware 
designing, math algorithms and programming. 

In this paper, we present FreelMU, an Open Hardware Framework for 
prototyping orientation and motion sensing capable devices. The frame- 
work consists in a small circuit board containing various sensors and a 
software library, built on top of the Arduino platform. Both the hardware 
and library are released under open licences and supported by an active 
community allowing to be implemented into research and commercial 
projects. 

Keywords: Prototyping, Open Hardware, Sensor Fusion, Orientation 
Sensing, Motion Sensing, MARG, IMU 

1 Introduction 

In the last five years, with the introduction of mainstream products such as the 
Apple iPhone or the Nintendo Wii, supported by remarkable advances in the sen- 
sors technology, orientation- and motion sensing-based interaction has become 
very common among consumer products. Such interaction is currently imple- 
mented in many products such as mobile phones, digital cameras, camcorders, 
tablets, etc. and it has been also used as key technology in various research 
projects ranging from HCI to Medical devices. 

The complexity behind implementing even simple orientation and motion 
sensing capable devices is however quite remarkable as it may require developing 
ad-hoc hardware supporting the sensors needed, understanding and implement- 
ing complex sensor fusion algorithms as well as developing embedded software 
for sensor reading. Such complexity makes the process of prototyping orientation 
and motion sensing capable devices time consuming, difficult, costly as well as 
difficult to maintain. 

This is probably the reason why much of the existing literature in HCI using 
some kind of orientation sensing relies on commercially available devices. The 
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Nintendo Wiimote, Apple iPhone and iPod Touch as well as Android phones or 
Playstation Move controllers, have been widely used as prototyping devices in 
orientation sensing and accelerometer based applications. Some of such works 
include |B], [7], [S] as well as MIT Funf Sensing Franieworl|^ The Wiimote has 
even been the base of the Wiimote hackery workshop held at TEI 2010 |20| . 

In our opinion, even if such devices proved to be effective in some prototyp- 
ing applications, there are many limits in specific implementations. The biggest 
limitation is the fact that they can't be easily used to prototype other devices 
or controllers. Using something like the Wiimote or iPhone poses various lim- 
itations in the size, features and costs of the prototype. This is a remarkable 
limitation when working on specific HCI devices in which the shape is to be 
evaluated during the prototyping. An example might be ad-hoc controllers used 
as physical representation of virtual information as part of Tangible User In- 
terfaces. In such applications, the controllers have various constraints in shape 
and size since they need to represent virtual information. Commercial devices 
generally can't be extended with other input /feedback technologies: even adding 
simple feedback capabilities, like for example an RGB light, can be challenging 
when using closed commercial products. 

This has been partially solved by the introduction of commercial sensor 
boards, usually designed for stand-alone operation or to be interfaced with 
microcontroller-powered prototyping boards, such as Arduino. However, even 
if these boards solve some of the hardware complexity of prototyping orienta- 
tion and motion sensing devices, they are still limited by the complexity of sensor 
fusion algorithms and programming. Some vendors provide their own sensor fu- 
sion firmware, however they usually release it as closed source software, thus 
extremely complex to embed in ad-hoc designed applications or to be extended. 

In this paper we propose the FreelMU framework developed to solve the need 
of rapid prototyping of orientation and motion sensing capable devices. In the 
paper we briefly describe the FreelMU framework, its hardware and libraries and 
then provide examples of it usage. References to related works are provided as 
well as a discussion of future developments. 

2 The FreelMU framework 

The FreelMU framework is composed by a small sensor board and a software 
library. The project has been developed as an Open Hardware with the contri- 
bution of a community of developers. 

The FreelMU hardware consists in a very small board containing 3-axis ac- 
celerometer, gyroscope and magnetometer in a 9 Degrees of Measurement (DOM) 
Magnetic Angular Rate Gravity (MARG) Inertial Measurement Unit (IMU). 
Later versions also feature an high resolution barometer. 

The board can be used with the FreelMU library, a set of easy to use APIs imple- 
menting sensor fusion algorithms on top of the Arduino platformjTU], allowing 
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the developer to easily obtain a precise 4 Degrees of Freedom (DOF) sensing 
device which is then capable of sensing its own yaw, pitch, roll and altitude with 
respect to the external world. When the tracking precision doesn't need to be 
accurate, it is also possible to track the complete motion of the device in 6 DOF. 

Starting from the FreelMU framework is easy to prototype orientation and 
motion sensing capable devices which use a FreelMU compatible board connected 
to an Arduino. Such setup, thanks to the flexibility of the Arduino platform, also 
allows to be easily extended with more sensors (eg. ambient light or proximity 
sensors), other input/output hardware (eg. buttons, joysticks, vibration motors) 
and communication technologies (eg. bluetooth, ZigBee or Wifi modules) making 
it perfect for prototyping HCI devices. In the context of TUIs, the FreelMU 
framework allows to enrich with orientation and motion sensing capabilities any 
object. Such objects could become virtual information handles which allow the 
user to move or rotate their virtual representation by interacting with them. 

3 FreelMU hardware 

We designed the FreelMU hardware following an iterative design process: in less 
than two years, thanks to low cost PCB prototyping services and DIY soldering 
capabilities, we designed, produced and tested, in collaboration with users from 
the community, seven different board designs. This design process allowed us 
to try different sensors available on the market and to adapt to new ones with 
improved features when they became available. 




Fig. 1. A PreelMU vO.4.3 board. 

Our latest design, FreelMU vO.4.3 (Figure [T]), uses an MPU6050 gyroscope 
and accelerometer, an HMC5883L magnetometer and an MS5611-01BA high 
resolution atmospheric pressure sensor in a 22x19 mm sized board. The board 
is thus capable of measuring various input stimuli: 3-axis digital output angular 
rate sensor (gyroscope) with selectable full-scale range of ±250, ±500, ±1000 and 
±2000 3-axis digital output accelerometer with selectable full-scale range 
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of ±2, ±4, ±8 and ±16(7, 3-axis digital output magnetometer with selectable 
full-scale range of ±0.88, ±1.3, ±1.9, ±2.5, ±4.0, 4.7±, 5.6± and ±8.1 Gauss 
and an high resolution barometer with full scale range of 10 to 1200 mbar with 
selectable resolution of 0.065, 0.042, 0.027, 0.018, 0.012 mbar. Such board can 
be bought ready to use for about 60 euro on some partner shops online. 

The FreelMU board can be connected to an Arduino or any other microcon- 
troller through the PC bus with only four connections required. Additionally, 
sensors interrupt pins are available allowing advanced uses such as interrupt 
triggered readings or firmware actions. 

All the hardware designs, including detailed bills of materials which are cru- 
cial when component selection has direct impact on the performance and relia- 
bility of the hardware, have been released under Open Hardware licences. This 
allows the designs to be studied, modified or embedded in other projects by 
third parties. Moreover, instead of using commercial hardware design software, 
generally expensive and rarely accessible to students, artists or hobbyists, we 
designed FreelMU using KiCAE[^ an open source hardware design software. 

4 FreelMU library 

The FreelMU library contains all the software to operate a FreelMU connected 
to an Arduino. The library, written in C/C++ with host software in Java/Pro- 
cessing and Python, contains high level functions to access raw or calibrated 
data from the sensors, perform sensor fusion algorithms as well as calibration 
procedures. 

Instead of spending months studying sensors functioning, sensor fusion algo- 
rithms or calibration problems, developers can simply obtain sensor data using 
high level APIs such as getRawValues () which simply returns raw sensor data, 
getValuesO to access calibrated sensor readings as well as getQO, getEulerO 
or getYawPitchRollO to obtain orientation estimates. Low level access to sen- 
sor configurations, whenever necessary by the developer, is provided by easy to 
use sensors C++ classes which avoid diving into the complex hardware aspects 
of the sensors. Developers are also capable of accessing data from the sensors 
through a simple serial communication protocol, useful when no custom firmware 
is needed but only the data from the sensors is required. 

As an example of the FreelMU library simplicity, listing [TT] implements an USB 
Inertial Mouse which uses pitch and roll angles to move the mouse pointer on 
screen. 

1 void loop ( ) { 

3 mySIMU. getYawPitchRoll(ypr) ; 

// scale angles to mouse movements, 
int X = map(ypr [1] , -90, 90, -10, 10); 

^ http://www.kicad-pcb.org/ 
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7 int y = map(ypr [2] , -90, 90, -10, 10); 

9 // move mouse 

Mouse . move(—x , y, 0); 

Listing 1.1. Implementation of a simple USB Inertial Mouse based upon the FreelMU 
framework and an Arduino Leonardo. Variables declaration omitted for brevity. 

Regarding sensor fusion algorithms, in order to compute the orientation of 
the board, we make use of the algorithm by Mahony et al. [S], originally de- 
veloped for usage on Unmanned Aerial Vehicles (UAV), and later extended by 
Madgwick to incorporate the magnetic distortion compensation algorithms from 
his algorithm |B] released as a reference quaternion implementatior|^ Such algo- 
rithm, considerably lighter than traditional Kalman filters, allows us to obtain 
orientation data up to 400Hz even on the limited memory and computing power 
of the Arduino microcontroller. 

The altitude of the board is computed by fusing the high resolution at- 
mospheric pressure readings coming from the MS5611 barometer with gravity 
compensated accelerometer readings through a complementary filter. We are ca- 
pable of measuring the device altitude with about 10cm precision and almost 
immediate response to motion. The planar displacements with regard to the 
Earth surface can be computed by double integrating the dynamic acceleration 
readings obtained from the accelerometer: such method yields imprecise results 
due to the noisy readings from the accelerometer and numerical errors during 
the integration, however it is still useful when the motion tracking does not need 
to be accurate. 

When the sensor board is rigidly attached to the object whose orientation is 
being tracked, the library is also capable of detecting taps and double taps as 
well as their direction and magnitude. 

Recently, the FreelMU library has been extended with calibration routines 
which reduce or nullify errors in the orientation estimation induced by sensor 
biases. Through a guided procedure and by performing a set of predefined mo- 
tions on the board, the user can obtain the calibration parameters which will 
then be used in the sensor software. A properly calibrated FreelMU framework, 
is capable of sensing orientations inferior to 2 degrees without drifting. 

The library is also accompanied by some visualization tools, written in Pro- 
cessing and Python, which allow the user to visualize the orientation and motion 
data from the sensors. These tools also serve as examples of interfacing with an 
host application on a PC. 

While the main platform to run a FreelMU is an Arduino (8-bit ATMEGA 
AVR microcontroller), the community is constantly porting the library to other 
platforms: at the moment there are ports available for the PIC24 microcontroller 
and NXP LPC1343 Cortex M3 while work is being done to port it to other 32 
bits platforms like the Arduino DUE or Teensy 3.0. 



3 



http : / In- io . CO . iik/iiode/8 



6 



The FreelMU library is released as open source software under the GPL v3 
license and is available from the FreelMU project websit^ 

5 FreelMU in Research, Education and Hobbies 

Despite that the FreelMU framework has been released only one and a half year 
ago, it has been already adopted in many research, education and hobbyists 
projects. 

In Galore et al. used a FreelMU and its library to extend a standard 
camera with orientation sensing capabilities. This enabled them to develop algo- 
rithms to automatically use the orientation data to correct pictures for horizon 
and keystone effect distortions. 

Varesano and Vernero used the FreelMU framework as key prototyping tool 
during the development of PALL A [I^, a spherical wireless input device designed 
for leisure activities for young children or elder users which uses the orientation 
and motion sensing capabilities provided by FreelMU as the main input features 
of the device. Such input features have been used in prototyping Pandagolf, a 
TUI based golf video game. 

The Pentacle [11], by Mitchell et al., is instead "a wireless interface for new 
musical expression" : by using a FreelMU connected to an Arduino FIC[^ with 
vibration sensing microphones and wireless communication, the authors devel- 
oped a musical instrument of dodecahedron shape. With the device, musicians 
can physically interact with digitally generated music through an orientation and 
motion sensing based interaction as well as through touching the microphone- 
equipped surfaces of the device. 

In |13I12| . Patillo developed the SmartSkelethon: starting from FreelMU 
Open Hardware designs and library, the author extended the board and soft- 
ware to allow the daisy chaining of many IMUs so that they could be attached 
to the limbs of a teaching skeleton. The SmartSkelethon thus allows students of 
the Human Anatomy and Physiology classes to interact with a virtual skeleton 
in order to visualize the effects of limb motions into muscles and joins attempting 
to ease the understanding and memorization of them. 

Russel et al instead, starting from the FreelMU library and using other open 
source hardware, developed a low-cost IMU based upon Jeenode, an Arduino 
compatible board with wireless communication capabilities [T3 . This platform 
has been used as prototyping platform for developing stride time estimation 
algorithms for usage in the anticipatory prediction of falls for older users P^. 

Veresano et al used the FreelMU Framework as teaching tool in an Orienta- 
tion and Motion sensing focused studio [18] . The same authors are also extending 
the FreelMU Framework with wireless communication and a GPU on board to 
be used as prototyping tool of unconventional HGI devices making use of DIY 
and Personal Fabrication technologies |17j. 

* 'http : //www, varesano .net/pro jects/hardware/Free IMu| 
^ http : //arduino . cc/en/Main/ArduinoBoardFio 
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Reifberger and Briiller, students at the University of Applied Sciences - Up- 
per Austria, are using FreelMU to extend a 3D head mounted display with 
orientation and motion sensing capabilities to allow for a completely immersive 
virtual reality gaming experienc^ 

The FreelMU has been also used by many hobbists in various kinds of 
projects: virtual reality, games, robots, etc. FreelMU has been extensively tested 
also as main sensor hardware in quadcopter UAVs applications: both the Multi- 
Wij^and Me gapirate NCj^ hobby grade open source flying controller software, 
support the FreelMU hardware on Arduino based platforms. 



6 Related Works 

While there is a wide literature that proposes frameworks to interact with com- 
mercial controllers like the WiiMote (eg: [TB] ) and general purpose sensor nodes 
(eg. [2]) there are only few works proposing frameworks composed by both hard- 
ware and software libraries for prototyping orientation and motion sensing. In 
^ the authors propose a framework composed by a wireless sensor board and 
gesture recognition algorithms. While their work on the algorithms is still inter- 
esting, their sensor hardware is now considerably outdated and the sensors used 
in FreelMU are considerably more accurate, faster and easier to interface. 

DUL Radio^ is a small sensor board containing an accelerometer, a micro- 
controller and wireless communication which has been designed for ease-of-use. 
While this device may be interesting for inexperienced developers, it may be also 
constraining compared to Arduino, as also noted by the authors. Our framework 
also aims to ease sensor based interaction prototyping, however we concentrated 
on not loosing the flexibility and extensibility of the Arduino platform while 
providing wider sensor input. 

Concerning commercial projects similar to our, when we started working 
on FreelMU back in 2010, there wasn't any similar board using all digital sen- 
sors. That's actually why the development of FreelMU started. At the moment 
however, some prototype friendly boards containing 9 DOM MARG sensors are 
available. Sparkfun 9 DOF Sensor Stick Razor IMtj^ or 3D Robotics Ar- 
duIMU-|- v^l^ are example of similar commercial products which also are Open 
Hardware and some are equipped with minor software libraries. 

Vectornav VN-lOOj^and X-IO X-IMU[3 

are instead remarkable examples 
of closed source commerial IMUs since they provide ready to use proprietary 
orientation sensing algorithms. 

^ http : //magma-s of tware .blo gspot . com/ 

ihttp : / /www . mult iwi i . com/ 
^ |http : / / code .google . com/p/megapirateng/l 
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From an hardware point of view, the FreelMU hardware is superior to both 
the Sparkfun 9 DOF Sensor Stick and Razor IMU since the sensors used in 
the FreelMU vO.4.3 board are more precise and less nois The FreelMU also 
features a barometer allowing to track the altitude of the prototyped device. 
The Razor IMU is also limited by being clocked at 8MHz while the FreelMU is 
compatible with 16MHz Arduino boards. The ArduIMU+ v3 uses sensors similar 
to those of the FreelMU but doesn't provide a barometer. Arguably the Razor 
IMU and ArduIMU+ v3 may be considered easier to use since they provide 
sensors and CPU on the same board while the FreelMU needs to be connected 
to an host Arduino board: we believe however that this is not a limitation when 
prototyping HCI devices since in the prototype there will probably be other 
sensors or input devices requiring additional connections, thus the 4 connections 
required by the FreelMU board shouldn't be a problem. 

From a software point of view, the FreelMU library provides a much richer 
and polished API compared to those offered by 3rd parties on the Razor IMU 
or ArduIMU+ v3. The FreelMU library is also the only one offering altitude es- 
timation and a calibration GUI. While we don't currently have tests comparing 
the FreelMU library orientation algorithm performance with the software for the 
Razor IMU or ArduIMU+ v3, according to some users "the FreelMU implemen- 
tation smoother, less noisy, and more responsive than the DCM based ArduIMU 
co(ie"[^ this is the reason why some many Razor IMU or ArduIMU+ v3 users 
ended up using or porting the FreelMU library to their hardware instead of using 
their board software. 

Compared to closed source IMU platforms, such as the Vectornav VN-100 
and X-IO X-IMU, while we don't currently have test comparing the orientation 
sensing of our platform with those, we believe that the FreelMU project can 
still give much greater possibilities then using a commercial platform. By being 
completely open, both from an hardware and software point of view, it can be 
freely implemented in 3rd parties derivative projects or products, something not 
possible when using closed source IMU platforms. 

The FreelMU is also the only IMU project we know supported by a very active 
community of users, organized in the FreelMU community websit sharing 
projects, code improvements and helping each other. 



7 Conclusions and Future work 

This paper presented FreelMU, a framework for prototyping orientation and 
motion sensing devices composed by a sensor board and a software library. 
We briefly explained the rationale behind the creation of the framework, we 

The ADXL345 accelerometer used in the Sparkfun 9 DOF Stick and Razor IMU only 
gives 256 digits/g of resolution {±2g scale) while the MPU6050 of the FreelMU vO.4.3 
gives 16,384 digits/g {±2g scale) thus being much more precise. Same considerations 
are applicable to the gyroscope. 

http: / /diydrones. com/forum/topics / freeimu-firmware-on-arduimu 
^® http;//freeimu. varesano.net/ 
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described its hardware and software components and shown various projects 
already taking advantage of the framework. 

As explained, we believe that FreelMU can represent a valuable contribution 
in HCI research since it allows for the easy prototyping of orientation and motion 
sensing capable devices abstracting from the complex aspects of hardware, al- 
gorithms and low level programming. The complete openness of the framework, 
both from the hardware and software points of view, supports the creation of 
derivative projects which can take advantage from the simplicity of the library. 
The flexibility of the Arduino platform, which runs the FreelMU library soft- 
ware, also allows to further extend the capabilities offered by our framework 
with additional input, output or feedback. 

We believe that the number of high quality derivative projects based upon 
the FreelMU framework in the academic, education and hobbyists communities, 
as presented in section [5] is a proof of the quality and possibilities offered by our 
framework. 

As future work, from a software point of view we are currently interested in 
adding gesture recognition to our library as well as improving the calibration 
procedure to ease the process for the end user of the prototype. The research in 
inertial sensors calibration is quite active so its probable that better calibration 
algorithms will be published in the future. From an hardware point of view, 
we are continuing to follow the development in sensors as we want to keep our 
board update with newer sensors in the future. We are also investigating the 
possibility of further extending the hardware adding a microcontroller and a 
wireless communication module, creating an Arduino-like with on board sensors 
and communication to further ease the prototyping. 
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